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FAILURE TOLERANT HIGH DENSITY DIAL ROUTER 

BACKGROUND OF THE INVENTION 
This invention is a continuation of prior application Serial No. 09/099,877, filed June 
18, 1998. 

This invention relates a high density dial router and more particularly to a Fault 
Tolerant Dial Router (FTDR) that can be automatically reconfigured around faults while 
other independently operating subsystems in the dial router continue to process calls. 

A dial router processes telephone calls from a Public Service Telephone Network 
(PSTN). The dial router formats received telephone calls into IP packets and routs the 
packets over a packet-based Local Area Network (LAN) or Wide Area Network (WAN). The 
PSTN serially multiplexes multiple telephone calls together into either PRI, channelized Tl 
(CT1), or channelized T3 (CT3) data streams or the European equivalent of CT1, which are 
referred to as CE1. The dial router accordingly includes PRI, CT1, CE1 and/or CT3 feature 
boards that separate out the individual calls from the data streams. Modems extract digital 
data from the individual telephone line channels. The router then encapsulates the digital 
data into packets that are routed onto the packet-based network, such as a fast-Ethernet LAN. 

Some dial router architectures break the dial router system into many very small 
subsystems cards. Each subsystem has a complete set of line interface units. When a failure 
occurs, the whole subsystem card is decommissioned and manually swapped by an operator 
with a standby subsystem card at a later time. Even if a line interface unit is partially 
operational, it is fully decommissioned if a failure is detected. Another problem is that the 
number of boards in the dial router is substantially increased since one redundant card is 
provided for each subsystem card. This redundant architecture results in large and bulky dial 
routers. 

Current dial routers provide little or no fault tolerance against failures that occur in the 
field. Upon encountering a failure, field service engineers typically swap out the entire dial 
router box. For example, when a single modem module in the dial router fails, the entire dial 
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5 router box is turned off and the modem card replaced. When the dial router is shut down, all 
calls coming into the dial router are disrupted. Because the dial router handles a large 
number of calls at the same time, any failure, no matter how small, disrupts all the 
information (data, voice, etc.). 

Accordingly, a need remains for a simple dial router architecture that reduces the 
10 disruption of calls caused by failures. 

S UMMARY OF THE INVENTION 
A fault tolerant dial router (FTDR) includes redundant subsystem resources that 
operate independently of telephone line interface connections, such as PRI, CT1, CE1 and 
15 CT3 interfaces. The redundant subsystem resources are switched active when a failure is 

detected in a currently activated dial router subsystem. Subsystem failures are automatically 
3 switched out under software control, providing uninterrupted service to users with limited 

3 performance loss. 

I The FTDR selectively detaches the PRI, CT1 or CT3 line interfaces from the "pool" 

U 20 of other subsystem resources inside the dial router box. The subsystem "pool" includes line 

framers, controllers and modem modules. The "pool" of resources typically include some 
Z redundancy so that one extra subsystem can be standing by for a given number of active 

4 subsystems. 

3 " Failures often occur in the line interface units, especially the CT3 line interface that 

" 25 can handle up to 672 calls. The FTDR switches out a failed line interface unit and 

automatically switches in a redundant line interface unit. 

The FTDR detaches the line interfaces from the "pool" of subsystem resources by 

using a DS1 cross-connect switch (DCCS). The PRI, CT1, CE1 or CT3 line interface units 

converts modem, telephone, facsimiles or other types of calls to discrete DS1 data streams. 

30 The DCCS is pre-programmed to route individual DS1 data streams to subsystems and 

backup subsystems in the same feature card or to subsystems in other feature cards in the 

FTDR. DS1 I/O lines connects together all the DCCS switches in the FTDR. 

When a failure is detected anywhere in the system, the DCCS is automatically 

reconfigured to route the DS1 data stream around the failed subsystem to another subsystem 

35 located elsewhere in the FTDR. If more failures are detected, the DCCS connects the DS1 
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5 data stream around the new fault to another available subsystem resource. The DCCS 
reduces call disruptions in the dial router due to failures and requires substantially less 
standby hardware than other dial routers. The invention is targeted, but not limited to, dial 
routers. For example, the FTDR is ideal for use by Internet Service Providers (ISPs) to 
increase call reliability and reduce system down time. 
10 The foregoing and other objects, features and advantages of the invention will become 

more readily apparent from the following detailed description of a preferred embodiment of 
the invention, which proceeds with reference to the accompanying drawings. 



RRIEE DESCRIPTION OF THF. DB A WTNGS 
1 5 FIG. 1 is a block diagram of a prior art dial router. 

FIG. 2 is a block diagram of a Fault Tolerant Dial Router (FTDR) according to the 
invention. 

FIG. 3 is a block diagram of a DS1 cross-connect switch (DCCS) according to the 
invention. 

20 FIG. 4 is a detailed diagram of a matrix element in the DCCS shown in FIG. 3. 

FIG. 5 is a detailed circuit diagram of the DCCS shown in FIG. 3. 
FIG. 6 is a flow diagram showing how the DCCS is reconfigured for a line interface 

failure. 



25 FIG. 7 is a flow diagram showing how the DCCS is reconfigured for a subsystem 

failure. 

TYRTATT TP DESCRIPTION 

FIG. 1 is a block diagram of a prior art dial router 12. Multiple telephone calls 15 in a 

PSTN 14 are aggregated by a multiplexer 16 into either channelized Tl (CT1) data streams or 

30 Integrated Services Digital Network (ISDN) PRI data streams. In Europe, the multiple 

telephone calls 15 are aggregated into channelized El data streams (CE1). The Tl channels 

are partitioned into 24 DSO time slots that each carry a separate telephone call. More calls are 

aggregated together by multiplexer 18 to form a channelized T3 (CT3) data stream. The CT3 

channel is partitioned into 28 DS1 time slots that each carry 24 DSO channels. Channelized 

35 Tl has a bandwidth of 1 .54 million bits per seconds (bps) and channelized T3 has a 
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5 bandwidth of 45.736 million bps. 

A Tl Line Interface Unit (LIU) 23 in the dial router 12 receives multiple calls on 
multiple Tl lines 17. A subsystem 22 includes a HDLC controller, framers and modems 
modules. The framer is coupled directly to the Tl LIU 23 and converts the Tl channel into 
separate DSO channels. The modems in subsystem 22 extract digital data from the DSO 
10 channel The packets are sent from the modems in subsystem 22 over a backplane 30 to a 
router/controller 28 that then encapsulates the data into packets and sends the packets out a 
packet based network, such as a LAN or WAN 32. A T3 Line Interface Unit (LIU) 24 
receives the DS1 data stream from the CT3 line 19. A framer in subsystem 26 separates the 
DS1 data stream into separate DSO channels. Modem modules in subsystem 26 extract 
1 5 digital data from the DSO channels. Router/controller 28 converts the digital data into 
: packets and sends the packets out to the LAN/WAN 32. 

5 J The LIU's 23 and 24 are connected directly to the subsystems 22 and 26, respectively. 

;3 Any failure in the Tl LIU 23 or associated subsystem 22 disconnects up to 30 ports (port = 

DSO channel). The only way to restore service to the 30 ports is to physically replace the 
1 20 function card (board) containing LIU 23 and subsystem 22. If a failure occurs in the T3 LIU 

24 or associated subsystem 26, even more calls are disconnected. 

Referring to FIG. 2, a Failure Tolerant Dial Router (FTDR) 12 according to the 

^ invention includes DS1 cross-connect switches (DCCS's) 32A-C in each feature card 46A- 

;3 " 46C, respectively. A T3 Line Interface Unit (LIU) 20A in feature card 46A receives a CT3 

" 25 line 17 and outputs DS1 data streams 21 to the DCCS 32A. Alternatively, the LIU 20A is 
•« 

configured to receive ISDN PRI linesrThe DCCS 32A is originally configured to connect the 

DS1 data streams 21 to a DS1 framer 34A. The framer 34A converts the DS1 data stream 

into DSO calls that are connected to modem modules 40A through a DSO cross-connect 

switch 36A. The modem modules 40A extract digital data from the DSO calls and then sends 

30 the digital data to a router/controller 28 over bus 44. DS1 I/O lines 33 A are coupled from 

DCCS 32A to DCCS 32B and 32C on the other feature card 46B and 46C through the 

backplane 30. The different functional elements such as the framer 34A and modems 40A on 

the right side of the DCCS 32A are referred to generally as a conversion subsystem 35. A 

processor 42A monitors the functional elements in feature card 46A for failures. 

35 A standby feature card 46B has the same functional elements as feature card 46 A. 
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5 The standby feature card 46B is coupled to the CT3 line 17 in parallel with the feature card 
46A. A CT1 or PRI feature card 46C is coupled to multiple CT1 lines 19 by individual CT1 
LIU modules 20C. Alternatively, the LIU modules 20C provide an interface for CE1 lines. 
The LIU modules 20C are coupled to a DCCS 32C. The subsystem to the right of DCCS 32C 
is similar to the subsystem 35 in feature card 46 A. ATI standby feature card 46F is similar 

10 to the CT1 feature card 46C and is coupled to the CT1 lines 19. The functional elements in 
the feature cards, other than the DCCS's 32A-C and the DS1 I/O lines 33A-C are known to 
those skilled in the art and are, therefore, not described in further detail. 

Any combination of feature cards can be used in the FTDR 12. The configuration 
shown in FIG. 2 is only one implementation shown only for illustrative purposes. For 

■15 example, there may be multiple CT3 feature cards 46A and multiple CT1 feature cards 46C. 
There may be one standby feature card 46B connected in parallel to each active CT3 feature 
card 46A or only one standby feature card 46B used as backup for multiple CT3 feature cards 
46A. 

Typically there is one-to-one redundancy for the CT3 feature cards 46A. This means 
20 that there is one standby CT3 card 46B for each normally operational CT3 card 46A. This is 
typically less redundancy, say 7-to-l redundancy, for the CT1 feature cards 46C. This means 
there is only one standby CT1 feature card 46F for 7 normally operating CT1 feature cards 
46C. 

Referring back to feature card 46 A, if a failure occurs on the CT3 lines 17, a relay in 
25 LIU 20B (not shown) is closed connecting CT3 line 17 to LIU 20B. DCCS 32B is 

automatically configured to connect LIU 20B over DS1 I/O lines 33 A. At the same time, the 
DCCS 32A in the normally active feature card 46A is reconfigured to switch out LIU 20A 
and switch in the DS1 I/O lines 33 A. 

The traffic on CT3 line 17 is in turn routed around LIU 20A to LIU 20B. The DCCS 
30 32B connects LIU 20B to DCCS 32A so that the traffic on CT3 line 17 goes through LIU 
20B, DCCS 32B and DCCS 32A to framer 34A. 

Iif a DS1 failure occurs in the conversion subsystem 35 (framer 34A, DSO cross- 
connect switch 36A, or modem modules 40 A), the DCCS 32A connects the DS1 channels 
either to the redundant module in the same feature card 46A or connects through the DS1 I/O 

35 lines 33 A to another feature card. For example, if a fault occurs in framer 34A, the DCCS 
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5 32A can reconnect the LIU 20A to redundant framer 34D in the same feature card 46 A. If 
both framers 34A and 34D fail, the DCCS 32A can connect the LIU 20A through DS1 I/O 
lines 33 and backplane 30 to DCCS 32B or DCCS 32C. The DCCS 32B or 32C connect LIU 
20A to framer 34B or framer 34C in one of the other features cards 46B or 46C, respectively. 
By adding the DCCS's 32A-32C and the auxiliary DS1 I/O lines 33 in the DS1 
10 domain, reconnecting telephone channels to different feature cards is faster and easier to 
control. If the DCCS's 32A-32C were inserted in the DSO domain (to the right of framers 
34A-34C), the cross-connect circuitry would be more difficult to control and require more 
complex circuitry. 

The DCCS's 32A-32C in combination with the DS1 I/O lines 33A-33C provide 
15 connectivity at the DS1 level between all the feature cards 46A-46C. A major advantage 
M= provided by the DCCS's 32A-32C is that faults in subsystem 35 can be isolated from faults in 

^ the LIU's 20A-20C. This allows a substantially greater number of reconfiguration 

;; fj possibilities and, as a result, more effective utilization of redundant dial router resources 

«f when a fault is detected. 

20 Another advantage of the FTDR 12 is that more functional elements in different cards 

I z can be used to provide redundancy for faults in any other card. For example, in an alternative 

□ configuration, feature card 46B is not a standby card coupled to CT3 line 17 but an active 

ui feature card connected to a separate CT3 line 37. If the subsystem 35 in feature card 46A 

: : f " fails, calls on T3 line 1 9 can be reconnected by DCCS 32A through DS 1 I/O line 33 A to 
25 DCCS 32B. Redundant framer and modem modules in the feature card 46B subsystem can 
then be used to convert the DS1 data stream from line 17 into digital packets. Feature cards 
that normally operate independently can now provide additional redundancy for other feature 
cards. 

There are two versions of the cross-connect switch. One version for the T3 feature 
30 card(s) 46A and 46B and the other version for the T1/PRI/E1 feature cards 46C and 46F. 

Both are functionally equivalent but the DCCS on the T3 feature cards 46A and 46B support 
more DS1 channels. 

The DCCS's 32A-32C are typically implemented using field programmable gate 

arrays (FPGA's). The DCCS's 32A-32C provide a 3-way switch matrix function. The DCCS 

35 32C cross-connects the framer 34C or redundant framer 34F to each one of six LIU's 20C on 
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the same feature card 46C. In a second configuration, the DCCS 32C cross-connects the two 
framers 34C and 34F to the DS1 I/O lines 33C. In a third configuration, the DCCS 32 cross- 
connects the six LIU's 20C to the DS1 I/O lines 33C. 

FIG. 3 is a block diagram of the DCCS 32C. Each functional element including LIU's 
20C, DS1 I/O lines 33C and framers 34C and 34F that connect to the DCCS 32C has 2 pair 
of associated signals. RJData and R_Clock are (Receive) signals input to the DCCS 32C and 
T_Data and T_Clock are output (Transmit) signals. The DCCS 32C connects the different 
functional elements 20C, 33C, 34C, 34F and 34C together according to control registers 43 
programmed by software via the processor 42. 

FIG. 4 shows a simplified implementation for a portion of the DCCS 32C used for 
switching the R CLK signals received from the subsystem elements 20C, 33C and 34C. The 
processor 42 loads a value in one of the control registers 43 that generates clock select signal 

SEL_CLK[1..0]. The asserted SEL_CLK[1..0] signal enables a multiplexer 46 to output one 

of the three receive clocks R_CLK1, R_CLK2, or R_CLK3 as the T_CLK1 clock. The 

receive clocks are generated by the LIU 20C, backplane I/O 33C or framer 34C, respectively. 
FIG. 5 is a detailed circuit diagram of the DCCS 32C. The circuit shown in FIG. 5 is 

replicated n times, where n is the number of inputs and outputs supported in the feature cards 

46A-46C. The following terms refer to the different signals received from and transmitted by 

the different elements in each feature card 46A-46C. 

LIU_R data[5:0]: Line Interface Unit 20C receive data; 

LIU_T Data[5:0]: Line Interface Unit 20C transmit data; 

LIU_RCLK[n]: Line Interface Unit 20C receive clock; 

LIU_TCLK[n]: Line Interface Unit 20C transmit clock; 

FRMR_RData[n]:Framer 34C receive data; 

FRMR_TData[n]:Framer 34C transmit data; 

FRMR_RCLK[n] :Framer 34C receive clock; 

FRMR_TCLK[n] :Framer 34C transmit clock; 

BKPLN_DS l_RData[n] : Backplane DS1 I/O 33C receive data; BKPLN_DS l_TData[n] : 
Backplane DS1 I/O 33C transmit data; 

BKPLN_D S 1 _RCLK[n] : Backplane DS1 I/O 33C receive clock. 

BKPLN_DS l_TCLK[n] : Backplane DS1 I/O 33C transmit clock. 
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5 The upper block in FIG. 5 shows DCCS 32C data control circuitry 52 and the lower 

block in FIG. 5 shows DCCS 32C clock control circuitry 54. Power and reset signals 
BRDJPWROK, BRD_RESET_L and Global_decoded_OE are used for resetting and 
enabling the DCCS 32C. A multiplexer (mux) 58 outputs either the BKPLN_DS1_R or 
LIU_R receive signal as the FRMRJR. Data[n] signal to the framer 34C. A mux 60 selects 
1 0 one of the LIU_RData[5 :0] signals for outputting as the BKPLN_D S 1 _RData[n] signal. A 
mux 62 selects one of the FRMR_Data[n] signals for outputting as the BKPLN_TData[n] 
signal. The clock circuitry 54 works in a similar manner for the clock signals switched 
between the different functional elements in the feature card 46C. 

FIG. 6 shows how the DCCS 32A is reconfigured for a CT3 line failure in the feature 
1 5 card 46A (FIG. 2). In step 70 the feature card 46A is activated while the standby feature card 
i. j, 46B remains in a standby mode. The activate feature card 46 A is continuously monitored by 

13 * processor 42 A for any line failures in LIU 20 A. If a failure is detected in LIU 20A, the 
□ processor 42A reports the fault to controller 28. The standby LIU 20D can be activated, if 

.; = available. If a standby LIU 20D is not available, controller 28 in step 74 deactivates the 

I 20 active feature card 46A and activates the standby feature card 46B. The DCCS 32 A is then 

reconfigured in step 76 to receive the DS1 channels from the now active feature card 46B 
n over the DS1 I/O lines 33A. The subsystem 35 in feature card 46A then converts the DS1 

W data stream into digital packets. Alternatively, the DCCS 32B and subsystem in card 46B is 

s;3 - used for converting the CT3 calls into packets. 

' ** 25 FIG. 7 shows how the DCCS 32A is configured for a failure that occurs in the 

subsystem 35 to the right of DCCS 32 A. For example, a failure that occurs in the framer 34 A 
or in one or more of the modem modules 40A. The DCCS 32A is configured in step 78 to 
connect the LIU 20A to framer 34A. The DSO switch 36A is configured to connect the DSO 
calls from framer 34A to the modem modules 40A. If a failure is detected in decision step 
30 80, the router/controller 28 is notified by the local processor 42 in step 82. 

If the failure is a DSO modem failure, the DSO switch 36A can be reconfigured in step 
90 to connect the DSO calls to spare modem modules 40A in step 90. If a DS1 modem failure 
is identified in decision step 86, then the entire bank of modem modules 40A have failed. 
The DSO switch 36A is then reconfigured to by-pass all the local modem modules 40A in 
35 step 92. Alternatively, step 92 reconfigures the DCCS 32A to bypass framer 34A and modem 
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5 modules 40 A altogether and connects the LIU 20A through the DS1 I/O lines 33 to another 
feature card. If a failure is detected in framer 34A, step 88 reconfigures the DCCS 32A to 
bypass the framer 32A and connects the LIU 20A either to the spare framer 34D on the same 
feature card 46A or to a framer on another feature card via DS1 I/O lines 33 A. 

As mentioned above, the DCCS provides a wide variety of different dial router 
1 0 configurations that isolate faults without having to shut down the entire dial router 12. 

Because more dial configurations are possible, more redundancy is provided while using less 
hardware. Thus, the dial router is more fault tolerant. 

Having described and illustrated the principles of the invention in a preferred 
embodiment thereof, it should be apparent that the invention can be modified in arrangement 
•15 and detail without departing from such principles. I claim all modifications and variation 
M : coming within the spirit and scope of the following claims. 

£3 
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